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Abstract 

The isospectral reduction of matrix, which is closely related to its Schur com- 
plement, allows to reduce the size of a matrix while maintaining its eigenvalues 
up to a known set. Here we generalize this procedure by increasing the number 
of possible ways a matrix can be isospectrally reduced. The reduced matrix has 
rational functions as entries. We show that the notion of pseudospectrum can 
be extended to this class of matrices and that the pseudospectrum of a matrix 
shrinks as the matrix is reduced. Hence the eigenvalues of a reduced matrix 
are more robust to entry-wise perturbations than the eigenvalues of the original 
matrix. We also introduce the notion of inverse pseudospectrum (or pseudoreso- 
nances), which indicates how stable the poles of a matrix with rational function 
entries are to certain matrix perturbations. A mass spring system is used to 
illustrate and give a physical interpretation to both pseudospectra and inverse 
pseudospectra. 

Keywords: Isospectral reduction, Schur complement, Pseudospectra, 
Frequency response. Spring mass network 
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1. Introduction 

The process of isospectrally reducing a matrix was first considered in [5], 
where it was shown that a weighted digraph could be reduced while maintaining 
the eigenvalues of the graph's weighted adjacency matrix, up to a known set. 
The motivation in this setting was to allow one to simplify the structure of a 
complicated network (graph) while preserving its spectral information. One of 
the main results of this paper is that any weighted digraph can be uniquely 
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reduced to a graph on any subset of its nodes via some sequence of isospectral 
reductions. 

Later it was shown in [4, that such matrix reductions could be used to im- 
prove the classical eigenvalue estimates of Gershgorin, Brauer, Brualdi, and 
Varga [HI HI 131 HI] ■ Specifically, the eigenvalue estimates associated with Gersh- 
gorin and Brauer both improve for any matrix reduction and can be successively 
improved by further matrix reductions. The eigenvalue estimates of Brualdi and 
Varga are more complicated but can be shown to improve for specific types of 
matrix reductions. 

In this paper we generalize this previous work by first showing that a matrix 
can be isospectrally reduced over any of its principal submatrices, under mild 
conditions. This is an improvement over the isospectral reduction method pre- 
sented in [11 ini |5] , since in these three papers a submatrix is required to have 
a particular form in order for the reduction to be defined. This fundamental 
improvement allows us to avoid the sequence of reductions that were previously 
necessary for certain matrix reductions. We prove in a more general setting that 
a sequence of reductions still leads to a uniquely defined matrix that depends 
only on the final reduction (see theorem [2|. 

As defined in [4] a matrix with rational function entries has both a spectrum 
and an inverse spectrum. When a square matrix is isospectrally reduced, the 
result is a smaller matrix that again has a spectrum and an inverse spectrum. 
The relation between the spectrum and inverse spectrum of the reduced and 
unreduced matrices is dictated by the specific submatrix over which the matrix 
is reduced (see theorem [I]). 

Expanding on the work done in [4] , we show that it is possible to not only use 
the eigenvalue estimates associated with Gershgorin to estimate the eigenvalues 
of a matrix, but to estimate its inverse eigenvalues. This is done by introducing 
the concept of the spectral inverse of a matrix, i.e. the matrix in which the 
eigenvalues are the inverse eigenvalues of the original matrix and vice versa. 
Therefore, the results found in [4] allow us to give estimates of the inverse 
eigenvalues of a matrix and use matrix reductions to improve them (see theorem 

Another reason we care about isospectral reductions is that they naturally 
arise in network models when we do not have access to all the network nodes. We 
use a mass spring network to illustrate this: the isospectral reduction amounts 
to the response of the network where we only have access to some terminal nodes 
(see example |4|. In the case where all nodes are accessible (i.e. all nodes are 
terminal nodes), the eigenvalues correspond to frequencies for which there is a 
non-zero node displacement that results in zero forces. For the reduced matrix, 
the eigenvalues indicate frequencies for which a non-zero displacement of the 
terminal nodes generates zero forces at the terminals. The inverse eigenvalues 
of the reduced matrix correspond to resonance frequencies, i.e. frequencies for 
which there is an extremely large force generated by a finite displacement of the 
terminals. 

The pseudospectrum of a matrix gives us the scalars that behave like eigen- 
values to within a certain tolerance. This concept is particularly useful in an- 
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alyzing the properties of matrices that are non-normal, i.e. do not have an 
orthogonal eigenbasis. The pseudospectrum of a complex valued matrix has 
been introduced independently many times (see [lO] for details). It has also 
been studied in the case of matrix polynomials |11[T]. Here, we extend the defi- 
nition of pseudospectrum to matrices with rational function entries. By use of 
the spectral inverse we also define the inverse pseudospectrum of a matrix in 
Section 1X2] 

As with complex valued matrices, the pseudospectra we define for a matrix 
with rational function entries is a subset of the complex plane whose elements 
behave, within some tolerance, as eigenvalues. Similarly, the inverse pseudospec- 
tra of a matrix is the set of scalars that act as inverse eigenvalues for a given 
tolerance. For the mass spring network we consider, the pseudospectra of the 
stiffness matrix are the values for which there are node displacements that gen- 
erate forces that are small relative to the displacement. The same is true of 
inverse pseudospectra, except these give way to forces that are large relative to 
the displacement. A given tolerance determines how "large" and "small" these 
forces are. 

We show that the pseudospectra of a reduced matrix are always contained 
in the pseudospectra of the original matrix for a given tolerance. This implies 
that the eigenvalues of a reduced matrix are less susceptible to perturbations 
than the original one. 

The paper is organized as follows. Section [2] introduces and extends the 
theory of isospectral matrix reductions. This section also includes the spec- 
tral inverse of a matrix along with the Gershgorin type estimates of a matrix' 
inverse eigenvalues. In Section [3] we define the pseudospectrum and inverse 
pseudospectrum of a matrix with rational function entries and show that the 
pseudospectrum of a matrix shrinks in size as the matrix is reduced. Throughout 
the paper we consider numerous examples, including the mass spring network 
mentioned above, which is used to give a physical interpretation to the concepts 
introduced in this paper. 

2. Isospectral Matrix Reductions 

In the first part of this paper we introduce the class of matrices we wish 
to consider; namely those matrices which have rational function entries. The 
reason we consider this class of matrices, as mentioned in the introduction, is 
that such matrices arise naturally if we wish or need to reduce the size of a 
matrix (or system) we are considering while maintaining its spectral properties. 
This procedure of isospectrally reducing a matrix and describing the spectrum 
of such matrices is the main focus of this section. 

2.1. Matrices with Rational Function Entries 

The class of matrices we consider are those square matrices whose entries 
are rational functions of A. Specifically, let C[A] be the set of polynomials in 
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the complex variable A with complex coefficients. We denote by W the set of 
rational functions of the form 



wi\)^piX)/q{X) 

where p(A),g(A) G C[A] are polynomials having no common linear factors and 
where g(A) is not identically zero. 

More generally, each rational function w(A) e W is expressible in the form 

ttiV + Oi-iA*^-^ + • • • + flo 
6jA.J' +6j_iA.J'-i H \-bo 



where, without loss in generality, we can take bj = 1. The domain of w{X) 
consists of all but a finite number of complex numbers for which q{X) = bjX^ + 
bj-iX^~^ + ■ ■ ■ + bo is zero. 

Addition and multiplication on the set W are defined as follows. For p(A) /q{X) 
and r(A)/s(A) in W let 

, , r\ ^ P(A).,(A)+,(A).(A) ^ 

q sj qWs{X) 

P . r\ _ p{X)r{X) 
q Sj^'^-qmX) 

where the common linear factors in the right hand side of equations ([T]) and ([2| 
are canceled. The set W is then a field under addition and multiplication. 

Because we are primarily concerned with the eigenvalues of a matrix, which 
is a set that includes multiplicities, we note the following. The element a of the 
set A that includes multiplicities has multiplicity m if there are m elements of 
A equal to a. li a € A with multiplicity m and a € B with multiplicity n then 

(i) the union ^ U i? is the set in which a has multiplicity m + ri; and 

(ii) the difference A — B is the set in which a has multiplicity m — n if 
m — n > and where a ^ A — B otherwise. 

Definition 1. Let W"^" denote the set of n x n matrices with entries in W. 
For a matrix M(A) G W"^" the determinant 

det (M(A) - XI) = p{X)/q{X) 

for some p{X) / q{X) G W. The spectrum (or eigenvalues) of M{X) is defined as 

cr{M)^{XeC:p{X)=Q}. 

The inverse spectrum (or resonances^ of M{X) is defined as 

cr"i (M) = {A e C : q{X) = 0}. 

Both a{M) and a^^{M) are understood to be sets that include multiplicities. 
For example, if the polynomial p{X) E C[A] factors as 

m 

p{X) = J|(A - tti)"' for a^eC and n^eN 
then {A G C : p(A) = 0} is the set in which at has multiplicity Ui. 
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Remark 1. Since C C W, definition^ is an extension of the standard defi- 
nition of the eigenvalues of a matrix to the larger class of matrices W"^". In 
particular, if M & i^nxn n^^j^ ct{M) are the standard eigenvalues of M . 

In what follows we may, for convenience, suppress the dependence of the 
matrix M(A) G W"^" on A and simply write M. One reason for this is that for 
much of what we do in this paper we do not evaluate M(A) at any particular 
point A G C. Rather, we consider M formally as a matrix with rational function 
entries. 

However, when we do consider the matrix Af(A) E W"^" to be a function 
of A we mean M is the function 

M : dom (M) C"''", 

where dom (M) are the complex numbers A for which every entry of Af (A) is 
defined. Surprisingly, it may be the case that a(M) ^ dom (M) as the following 
example shows. 

Example 1. Consider the matrix M{X) E W^^^ given by 



M(A) = 



i 




As one can compute, det(M(A) — XI) — A^ implying a{M) = {0,0}. Therefore, 
a{M) ^ dom{M). 

2.2. Isospectral Matrix Reductions 

We can now describe an isospectral reduction of a matrix M E W"^". We 
then compare the spectrum of M to the spectrum of its isospectral reduction. 

Let M E W"^" and iV = {1, . . . , n}. If the sets n,C C N are non-empty 
we denote by M-jic the \Tl\ x \C\ submatrix of M with rows indexed by TZ and 
columns by C. Suppose the non-empty sets B and I form a partition of N. The 
Schur complement of Mxx in M is the matrix 

M/Mxi = Mbb - MbiM^^ Mib , (3) 

assuming Mxx is invertible. 

The Schur complement arises in many applications. For example, if the 
matrix M is the Kirchhoff matrix of a network of resistors with n nodes then its 
Schur complement is the Dirichlet to Neumann (or voltage to currents) map of 
the network given by considering the nodes in B as terminal or boundary nodes 
and the nodes in I as interior nodes (see e.g. [7]). A physical interpretation of 
an isospectral reduction is given in example |4j 

We are now ready to define the isospectral reduction of a matrix M E W"^". 

Definition 2. For M(A) E W"^" let B and I form a non-empty partition of 
N. The isospectral reduction of M over the set B is the matrix 

Rx{M- B) = Mbb ~ Mbx{Mxx ~ Xiy^MxB e W'^l^l^l. (4) 

if the matrix Mxx — ^I is invertible. 
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Note that the reduced matrix R\{M;B) is a Schur complement plus a mul- 
tiple of the identity: 



Rx{M; B) = {M- XI)/{Mxi - XI) + XL 



(5) 



More often than not we suppress the dependence of R\{M; B) on A and instead 
write it as R{M;B). 



Example 2. Consider the matrix M e 



/6x6 



with (0, l)-entries given by 



M = 



110 
10 11 
10 10 

10 10 

1 
1 



For B — {1,2} and I = {3, 4, 5, 6} we have 
{Mix - A/)-i = 



1 

l-A 









1 

l-A 





-i 

The isospectral reduction of M over B = {1, 2} is then defined as 



R{M-B) 




1 



1 1 

A-l A-1 

1 A+1 
A A 



110 

11 



,2x2 



1 

l-A 









1 

l-A 









\ 

-\ 



1 

1 

1 
1 



If a matrix has an isospectral reduction the spectrum and inverse spectrum 
of the isospectral reduction and the original matrix are related as follows. 

Theorem 1. (Spectrum and Inverse Spectrum of Isospectral Reduc- 
tions ) 

For M(A) e W"^" let B and! form a non-empty partition of N . If Rx{M;B) 
exists then its spectrum and inverse spectrum are given by 

a{R{M-B)) = ((T(M)Ua-i(Mxi)) - {a{Mii)\J a-^{M)) ; and 
a-\R{M-B)) = {a{Mxx) U a-\M)) - {a{M) U a-\Mxx)) ■ 



Proof. For M E W"^", we may assume without loss of generality that M has 
the block matrix form 

Mil MxB 
Mbx Mbb 



M = 



(6) 
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where Mxi — A/ is invertible. 

Note that the determinant of a matrix and that of its Schur complement are 
related by the identity 



det 



A B 
C D 



Aet{A)-Aet{D^CA-'^B), (7) 



provided the submatrix A is invertible. Using this identity on the matrix M — \I 
yields 

det(M - XI) = det(Afxi - A/) • det {{Mbb - A/) - Mbi{Mii - \I)~'^Mib) . 
Therefore, 

To compare the eigenvalues of R{M;B), M, and Mix write 

det(Af - A/) - 4tY and det(Afii - A/) = ^TT' 
q{X) u(\) 

for some p/q, t/u £ W. Hence, 

p{XHX) 



det (i?(M; B) - XI) 



q{X)t{X) 



Let P = {A G C : p{X) = 0}, Q = {A e C : q{X) =0},T = {XeC : t{X) = 0}, 
and U = {A S C : u(A) = 0}, with multiplicities. By canceling common linear 
factors, definition [l] implies 

a{R{M;B)) ={A e C : p{X)u{X) ^ 0} - {A G C : q{X)t{X) = 0} 
= {PUU) - (QUT); and 
<T-^ {R{M; B)) ={A e C : q{X)t(X) = 0} - {A G C : p{X)u{X) = 0} 

=(Qur)-(Puc/). 

Since P = a{M), Q = (J-'^{M), T = cr^H^xi), and R = (7{Mxx) the result 
follows. □ 

Since a matrix M £ (j^nxn inverse spectrum (i.e. cr~^(Af) = 0), 

theorem [T] applied to complex valued matrices has the following corollary. 

Corollary 1. For AI{X) £ C"^" let B and I form a non-empty partition of N. 
Then 

cr{R{M;B)) = a{M) - a{Mxx) and cj-'^ {R{M ; B)) = ct{Mxx) - <y{M). 

Example 3. Let M, B and I be as in example^ As one can compute cr{M) = 
{2, —1, 1, 1, 0, 0} and cr(AIxx) = {I7 1, 0, 0}. By corollary^ we then have 

(j{R{M-B)) ={2, -1,1, 1,0,0} -{1,1, 0,0} = {2,-1}; and 
a-^ {RiM; B)) = {1, 1, 0, 0} - {2, -1, 1, 1, 0, 0} = 0. 
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Observe that, by reducing M over B we lose the eigenvalues corresponding to 
the "interior" degrees of freedom a{Mxi) — {1,1,0,0}. That is, if we knew 
both a{Mxx) and a{R{M]B)) but not a{M), then corollary^ states that the set 
a{Mxx) is the most by which a[R[M;B)) and a{M) can differ. 

Theorem [T] therefore describes exactly which eigenvalues we may gain from 
an isospectral reduction and which we may lose. In this way an isospectral 
reduction of a matrix preserves the spectral information of the original matrix. 
However, it may not always be possible to find an isospectral reduction of a 
matrix M e W"^". 

For instance, consider the matrix M e W^^^ given by 



M 



1 1 
1 A 



(8) 



For B — {1} and I — {2} note that Mxx — A/ = [0], which is not invertible. 
Therefore, M cannot be isospectrally reduced over B. 

In general there is no way to know beforehand if the isospectral reduction 
R{M; B) exists without computing (Mri — A/)~^. However, the following subset 
of W"^" can always be reduced over any nonempty subset B C N. 

For any polynomial p{X) € C[A], let deg(p) denote its degree. If w{X) = 
p{X)/q{X) where both p{X),q{X) e C[A] are not identically zero we define the 
degree of the rational function w{X) by 

tt{w) = deg(p) - deg(g). 

In the case where p{X) = we let tt{w) = 0. 

Definition 3. We denote by W^r the set of rational functions 

= {w e W : tt{w) < 0} 

and let W"^" be the set of n x n matrices with entries in W^r. 

Lemma 1. If M{X) e W;j^" and B C N ts non-empty then Rx{M;B) G 
Wl8|x|8|_ 

Proof. Let M £ W"^". The inverse of the matrix M — XI is given by 

(M-A/)- = ^^^^^^^adj(A./-A/) (9) 

where adj(Af — A/) is the adjugate matrix of M—XI, i.e. the matrix with entries 

adj(M - A/)„- = (-1)'+^ dct{Mj,), l<i,j<n, (10) 

where Mij G is obtained by deleting the i— th row and j—th 

column of M — XI. 
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Note that 



det(M - A/) = 5] ( sgn(p) ^(M - A/) 



)i,p{i) 



(11) 



where the sum is taken over the set Vn of permutations on N. The sign sgii{p) 
of the permutation p G T'n is 1 (resp. —1) if p is the composition of an even 
(resp. odd) number of permutations of two elements. 



Using equations (A.2) and (A.4) in Appendix A the term in (11) corre 



sponding to the identity permutation p = id € Vn has degree n while for p ^ id 



the other terms have degree strictly smaller than n. Equation ( A.l I then implies 



(det(Af - A/)) = n. 



(12) 



Therefore det(M — XI) is not identically zero, implying via equation Q that 
the inverse (M — A/)~^ exists. Similarly, ioi i G N the matrix Ma is equal to 
Mu - XI for some M G wi""^^''^""^\ Hence, 



7r( det(A^i,,)) = n - 1, for i e iV. 



(13) 



For i ^ j the matrices A4ij G W*^" i)x(n i) ^Qj^^^in n — 2 entries of the form 



Mki — X where all other entries of Mtj belong to the set 



(A.2) and (A.4) imply that for i ^ j 



r(det(A^,y)) < n - 2, for iJeN 



Hence, equations 



(14) 



since for p € Vn-i at most n — 2 terms in the product Jlfe^i (-^u)*:,p(fe) have 
the form Mki — A. 



Given that the d egree of det(A^.y) in (14 1 may be zero, equations (12)-(14| 
together with (|A.3|) imply that tt{(M - XTjf^) < for all 1 < h j ^ Hence, 



(M - A/)"^ e W^^". Therefore, if B and I form a nonempty partition of TV 
then 

[(M-A/)-i]^^eWlfl><l^l. 

Definition [2] along with equations (A.2) and (A.4) then imply that R{M-,B) has 



entries in 



□ 



Note that lemma[T] implies the existence of any isospectral reduction R{M; B) 
if M e W^^" and B C N. In particular, any complex valued matrix can be 
reduced over any index set. Since the matrix M given in ([8| does not belong to 
W^^^ lemma [1] does not apply in this particular case. 

Remark 2. Because a matrix M e W^^" can be reduced over any nonempty 
index set B C N , the isospectral reductions presented here are more general than 
those given in ^\^\^. In these three papers, for M to be reduced over the index 
set B the matrix Mxi was required to be similar to an upper triangular matrix. 
Here, we have no such restriction. 
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In the following example we demonstrate how one can use an isospectral 
reduction to study the dynamics of a mass-spring network in which access is 
limited. 

Example 4. Consider the mass-spring network illustrated in figure [1} with 
nodes at locations Xi, i — 1, 2, 3, 4 lying on a line and edges representing springs 
between nodes. For simplicity we assume that all the springs have the same 
spring constant (k = 1) and that all the nodes have unit mass. (The precise 
position of the nodes on the line does not matter for this discussion.) 

Suppose each node Xi is subject to a time harmonic displacement Ui{(jj)e^^^ 
with frequency uj in the direction of the line and j — \/— T. Then the resulting 
force at node Xi is also time harmonic in the direction of the line and is of the 
form fi{Lo)e^^* . Writing the balance of forces acting on each node with the laws 
of motion, one can show that the vector of forces f (w) — [/i(a;), . . . , /4(a;)]'^ is 
linearly related to the vector of displacements u(cj) = . . . , 1*4(0;)]^ by the 

equation 

{{io) ^ (K -io^I)u{uj). (15) 
Here the matrix K is the stiffness matrix 



K 



1 -1 
-1 2 -1 

-1 2 -1 
-1 1 



If we let \ = up' , we see that the eigenmodes of the stiffness matrix K correspond 
to non-zero displacements that do not generate forces. For instance, the eigen- 



mode corresponding to the zero frequency is u — [1,1,1,1] 



by displacing 



all nodes by the same amount, there are no net forces at the nodes. 

Suppose we only have access to certain terminal (or boundary) nodes of this 
network, say B = {1,4}. Then we can write the equilibrium of forces at the 
interior nodes X = {2,3} and conclude that the net forces fg at the terminal 
nodes depend linearly on the displacements ug at the terminal nodes according 
to the equation 

fe(^) = {R^AK:B)-u?I)v.b{u:). (16) 
The spectrum and inverse spectrum of the response are 

a{R^2 {K; B)) = {2 ± ^2, 2, Q}andu-\R^2 {K; B)) = {3, 1}. 

The eigenvalues of R^2 [K; B) correspond to frequencies for which there is a 
displacement of the boundary nodes B that generate no forces at these nodes. 
Conversely, the resonances (or inverse eigenvalues) of R^2[K;B) correspond to 
frequencies at which there is a displacement of the boundary nodes for which the 
resulting forces are infinitely large. 
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Xi 



X2 



X3 



X4 



Figure 1: The mass spring network of example [4] with boundary nodes B = {1, 4} and interior 
nodes I = {2,3}. 



2.3. Sequential Reductions 

In the previous section we observed that the isospectral reduction i?(M; B) 
of M e WJJ^" is again a matrix in W™^™. It is therefore possible to reduce 
the matrix R{M;B) again over some subset of B. That is, we may sequentially 
reduce the matrix M. However, a natural question is to what extent does a 
sequentially reduced matrix depends on the particular sequence of index sets 
over which it has been reduced. 

As it turns out, if a matrix has been reduced over the index set Bi then B2 
up to the index set Bm then the resulting matrix depends only on the index 
set Bm- To formalize this, let M G W^^" and suppose there are non-empty 
sets Bi, . . . , B„i such that N D Bi D, . . . , D Bm- Then M can be sequentially 
reduced over the sets Bi, . . . , Bm where we write 

RxiM;Bi, . . .,Bm) ^Rx{--- RxiRxiM; Si); S2) . • . 

If M is sequentially reduced over the index sets Bi, . . . , Bm we call Bm the final 
index set of this sequence of reductions. 

Theorem 2. (Uniqueness of Sequential Reductions) For M{X) G W"^" 
suppose N D Bi D, . . . ,D Bm where Bm is non-empty. Then 

Rx{M-Bi,...,Bm)^Rx{M-Bm)- 

That is, in a sequence of reductions the resulting matrix is completely spec- 
ified by the final index set. To prove theorem [2] we first require the following 
lemma. 

Lemma 2. Let the non-empty sets B, I, and J partition N. If M{\) e W^^" 
then Rx{M;BU I, B) = Rx (A/; B) . 

Proof. Assume without loss of generality that M G W"^" can be written as 
M{X) = 

Using the definition of isospectral reduction we have 

«.(M;e) = M„-[M„ M„][«-;/^ M^^A/l'fe] "'^ 

(17) 



MxB 
MjB 



Mil 
Mji 



Mbj 
Mij 
Mjj 
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RxiM;BUl) 





Mbx 




'Mbj 


Mis 


Mix 




Mij_ 



{Mjj - A/)-i [MjB Mjx] . (18) 



Taking the isospectral reduction of R\{M; BU2) over ,B in ( 18 ) we have 

MxjK{Xy'MjB)] , (19) 



Rx{M; BUI,B) = Mbb ~ MbjK{X)-HIjb 
- [{Mbi - MBjK{\)-Hlji)T{\r\MiB 



where K{X) = Mjj - \I and r(A) = Mn - A/ - MijK{\)-^ Mji. Note that 
both K{\)^^ and r(A)^^ exist following the proof of lemma [ij To show the 
desired result we need to verify that expressions (17) and (fTol) are equal. 



Recall the following identity for the inverse of a square matrix M with 2x2 
blocks: 



(20) 



where E ^ A — BD^^C is the Schur complement of D in M. The determinantal 
identit y ([7| implies that M is invertible if and only if D and E are invertible. 
Using (|20| to find the inverse of the 2x2 block matrix appearing in (17) we get 



1 _ 


'A 


B 


-1 


E-^ -E-^BD-^ 




C 


D 




-D-^CE-^ D-^ + D-^CE-^BD-^ 



Mix - XI Mij 

Mjl Mjj - XI _ 

r(A)-i -T{X)-^MijK{X)-^ 
-K{\)-^MjiT{\y^ K{X)-^ + K{\)-HljiT{\)-^MijK{\)-^ 



(21) 



□ 



Using ( [21) ) in ( [T7| we get ( [T9| completing the proof. 

We now give a proof of theorem [2] 

Proof. For M e W;?^" suppose iV C Si D • • • D 6™ where B„, 7^ 0. If m = 2 
then lemma [2] directly implies that Rx[M] Si, S2) = R\{M ; S2). For 2 < fc < m 
suppose Rx{M-Bi, ...,Bk) = Rx{M;Bk). Then 

Rx{M;Bi, . . .,Bk,Bk+i) = RxiM;Bk,Bk+i) = Rx{M-Bk+i) 

where the second equality follows from lemma [2] By induction it then follows 
that Rx{M-Bu...,B^) = Rx(M-B^). □ 

Example 5. Let M g C''^'* he the matrix given by 



M 



10 10 
10 1 
111 
10 11 



12 



and let B = {1,2}. Our goal in this example is to illustrate that 



Rx{M-B) 
As one can compute 



Rx{M- 6 U {3}, S) - Rx{M- S U {4},6). 



Rx{M-B\J{i}) 



1 
1 

A-l 
1 

A-l 



1 
1 

A-l 

A 
A-l 



and Rx{M-B\J{A}) 



1 

A-l 
1 
1 

A-l 



1 

A-l 

1 

A 
A-l 



Although Rx{M; BU {3}) 7^ Rx{M; BU {4}), note that by reducing both of these 
matrices over B = {1,2} one has 



Rx{M; B) = Rx{M; B U {3}, B) = Rx{M; B U {4}, B) = 



-2A+1 



A2-2A 
A-l 

A2-2A 



A-l 
A2-2A 
A''-2A+1 
A2-2A 



As a final observation, we note that a{M) — {^(3 ± |(1 ± 3)} and 
a{Mii) = {0,2} for I = {3,4}. Hence the matrix M and the reduced matrix 
R{M, B) have the same eigenvalues by corollary [7| That is, an isospectral re- 
duction need not have any effect on the spectrum of a matrix. (In this example 
the inverse spectrum does change with the reduction). 

2.4- Spectral Inverse 

Although a matrix M £ W(A)"^" has both a spectrum and an inverse spec- 
trum, the techniques that have been developed to analyze its spectral properties 
have been restricted to its spectrum 2nBj |5j . The goal in this section is to in- 
troduce a new matrix transformation that exchanges a matrix' spectrum and 
inverse spectrum. This transformation allows us to investigate the inverse spec- 
trum of these matrices with tools meant to study its spectrum. Additionally, 
we use this transformation to define the inverse pseudospectrum (or pseudores- 
onances) of a matrix from the pseudospectrum of a matrix (Section [3]). 

Definition 4. For M(A) e W"^" let Sx(M) e W"^" be the matrix 

Sx{M) = (M(A) - A/)-i + XIe W"''", 

if the inverse (Af(A) — XI)^^ exists. The matrix Sx{M) is called the spectral 
inverse of the matrix M(A). 

We typically write the spectral inverse of M € W"^" as S{M) unless other- 
wise needed. We also observe that not every matrix M e W"^" has a spectral 
inverse. For instance, the matrix 



M = 



A 
A 



cannot be spectrally inverted. However, if M has a spectral inverse then the 
following holds. 
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Theorem 3. Suppose M{\) G W"^" has a spectral inverse S{M). Then 

a{S{M)) = a-\M) and {S{M)) ^ a{M). 
Proof. Let A/(A) E W"^" with spectral inverse S{M). Note that 

det {{S{M) - \I){M - XI)) = det ((M - XI)-^{M - XI)) = det(/) = 1. 
As the determinant is multiphcative then 

det(S'(M) - XI) = det(M - XI)-\ 
and the resuh follows. □ 

A matrix M € W"^" may or may not have a spectral inverse. However, 
if M G W^^" then the proof of lemma [l] implies that M — XI is invertible. 
Therefore, S{M) exists. This result is stated in the following lemma. 

Lemma 3. If M{X) E W"^", then M{X) has a spectral inverse. 

Example 6. Let M E W^^"' he the matrix given by 



M = 

for which we have 

det (M(A) - XI) = 












1 

A 



- 4A6 + 6A'' - 4A2 + 1 
A4 ■ 



As one can calculate, the spectral inverse S{M) is the matrix 



SiM) = 



A2-1 







-A 


-A^ 


-A^ 


(A2-l)2 

-A 


(A2-l)3 

-A^ 


(A2-l)4 

-A^ 


A^-l 



(A2-l)2 

-A 


(A2-l)3 

-A^ 


A2-1 


(A2-l)2 








A2~l 



XI. 



Taking the determinant of S (M) — XI one has 
det (5(M) - XI) = _ ^ 
That IS, det {S{M) - Xl) = det(M(A) - XI)-\ 



A4 

6A4 - 4A2 



Observe, that for any M E W;j^" the spectral inverse S{M) ^ W^^". There- 
fore, we have no guarantee that S{M) can be isospectrally reduced. However, 
the following holds. 
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Theorem 4. (Reductions of the Spectral Inverse) For M{\) G W"^" 
suppose N Z) Bi Z), ■ . ■ ,Z) Bm where Bm is non-empty. Then 

(i) Rx{S{M);Brn) exists; 

(ii) Rx{S{M);Bi, . . . ,B^) ^ Rx{S{M)-Bra); and 

(iii) Rx{S{M)-B) = (M - / [{M - + XI where I = N - B,n. 

Proof. For M G W^^" suppose B and I form a non-empty partition of N. By 
lemmas [l] and [sj the matrix S{M) exists and 

s{M) -XI = (M - xiy^ e W^J""". 

Equating blocks in the previous equation gives that the matrices [S{M)]bb — XI, 
[S{M)]bx, [S{M)]xb and [S{M)]xx - XI all have entries in W^. Moreover 
[S{M)]xx — XI is not identically zero so its inverse exists. We deduce that the 
reduction of S{M) exists and is 

Rx{S{M);B) - A/ = {[S{M)]bb - XI) - [S{M)]bx ([^(Af)]ii - Xiy' [5(M)]xb 

g ^|B|x|B|_ 

To prove (iii), simply notice that [S{M)]bb-XI = [{M - A/)"^]gg, [S{M)]xb = 
[S{M)-XI]xB = [{M - A/)-i]^g, [S{M)]bx = [{M ~ A/)-%^ and [S{M)]xx- 
XI = [(M - A/)-!]^-^-. These relat ions imply (iii). 

Substituting each submatrix M-jic in the proof of lemma 2 by the matrix 



S{M) 



nc 



' (A/ - A/)7jJ. + A/ if7^ = C, 
(A/ — A/)^J, otherwise 



and then following the proof of theorem [2] using S{M) instead of M yields a 
proof of part (ii). □ 

Theorem|4]states that any matrix M € W^^" has a spectral inverse and that 
this inverse can be reduced over any index set. Observe the similarity between 
equations ([s]) and part (iii) of theorem |4j 

2.5. Gershgorin-Type Estimates 

If M e W"^" then its inverse spectrum (j^^{M) are the complex numbers 
at which the determinant det(Af — XI) is undefined. Since the determinant of a 
matrix is composed of various products and sums of its entries then equations 
([l]) and ^ imply the following proposition. Hereinafter for A C C, the set A is 
the complement of A in C. 



Proposition 1. If M{X) e W"^" then a-^{M) C dom{M). 

Phrased another way, the inverse eigenvalues of a matrix M £ W"^" are 
complex numbers at which the matrix M is undefined, i.e. in the complement 
of dom(M). However, it is not always the case that the converse holds as the 
following example demonstrates. 



15 



Example 7. Consider the reduced matrix 

1 1 



R{M-B) 



A-l A-1 
I A+1 
A A 



72x2 



fou nd in example^ As computed in example^ we have a ^{R{M]B)) = and 
yet dom[R[M-B)) = {0,1}. 

To improve upon proposition [l] we look for methods of estimating the inverse 
spectrum of a matrix. The following well-known theorem due to Gershgorin 
gives a simple method for approximating the eigenvalues of a square matrix 
with complex valued entries. 

Theorem 5. (Gershgorin J5|/) Let M e C"^". Then all eigenvalues of M 
are contained in the set 

n n 

r{M)^\J{\eC:\X-Mu\< I^^'^l}- 

1=1 j = lj:^i 

In j4] it was shown that Gershgorin's theorem can be extended to matrices 
M g W"^". Our goal in this Section is to further extend this result by using 
the spectral inverse introduced in Section [2. 4| to estimate the inverse spectrum 
(or resonances) of matrix AI E W"^". To do so we first define the notion of a 
polynomial extension of the matrix M. 

Definition 5. ForM{\) e W"^" with entries Mij = p^j/q^j fefLi(M)=n"=i lij 
for 1 < i < n. We call the matrix M given by 

— {LiNhj i^j 1 ^ ■ . ^ 

\^Li[Mij - X) + X i=j 

the polynomial extension of M . 

Note that for any M e W"^" the matrix M € C[A]"^". The following the- 
orem extends Gershgorin's original theorem to matrices in W"^" (see theorem 
3.4 in m). 

Theorem 6. Let M{X) e W"""". Then a{M) is contained in the set 

n n 

r(M)-|J{AeC:|A-M,,|< ^ |M,,|}. 

1=1 j=i,j^i 

We call the set T{M) the Gershgorin-type region of the matrix A/ or simply 
its Gershgorin region. (The notation in [3] is ByVriM)). 

An immediate corollary to theorem [3] and theorem [6] is the following. 

Corollary 2. Let M{X) E W"^". Then a'^M) is contained in the set 

n n 

T{S{M)) = \J{XeC:\X-S{M)u\< E 

i=l j = lj-^i 
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Figure 2: Left: r(S(M)). Right: r{R{S{M);B)) where the inverse spectrum a-^{M) = 
{0,0,0,0} is indicated by a "x". 



Example 8. Let M G W^^"' he the matrix considered in example^ Then 
-A(A2-1)9 -A(A2-1)8 -A2(A2-1)7 -A3(A2-1)6 

-A(A2-1)5 -A2(A2-1)4 -A3(A2-1)3 



-A(A2-1)2 -A2(A2-1)1 

-A 



XL 



The region r(S'(Af)) is shown in figure^ (left). 

We note that the Gershgorin-type region T{S{M)) is the union of the sets 

n 

r{S{M)U = {XeC:\X^S{M~U< E l^.jl}' 

fori = 1,2,3,4. The regions r{S{M))i, r{S{M))2, andT{S{M))3 in figure\^ 
are shown in blue, green, and red respectively. Transparency is used to highlight 
the intersections. The same strategy is used in Section^to display pseudospectra 
(or inverse pseudospectra) of a matrix. The set T{S{M))4^ — {0} is contained in 
the inverse spectrum a~^{M) — {0,0,0,0}, which is indicated in the figure. 

One of the main results of [J is that the Gershgorin region of a reduced 
matrix R{M; B) is a subset of the Gershgorin region of the unreduced matrix 
M e W"^" (see theorem 5.1 [4 ). In the same way the inverse eigenvalue 
estimates given in corollary [2] can be improved via the process of isospectral 
matrix reduction. 

Theorem 7. (Improved Inverse Eigenvalue Estimates) Let M{X) E W"^" 
where B is any nonempty subset of N . Then 

r{R{S{M);B)) C r(5(A/)). 

A proof of theorem [7] can be obtained by following the proof of theorem 5.1 
in [3] and by using theorem |4]^ii) . 
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Example 9. Let M G W^^"^ be the matrix given in example^ For the index 
set B ~ {1,2,3}, the reduction of the spectral inverse of M is 



R{SiM);B) 



-A 
A2-1 






-A 

(A2-l)2 

-A 
A2-1 





-A^ 
(A2-l)3 

-A^ 
(A2-l)2 

A2^- 



Its polynomial extension follows: 



R{S{M);B) = 



-A(A2-1)9 -A(A2-1)8 -A2(A2 
-A(A2 - 1)5 -A2(A2 

-A(A2 - 



XI 



-1)4 
1)2 



XI. 



The Gershgorin-type region of the reduced matrix R{S{M);B) is shown in figure 
^ (right) where one can see that a-^{M) C T{R{S{M)-B)) C T{S{M)). The 
regions T{R{S{M); B))i and T{R{S{AI); B))2 are in blue and red, respectively. 

Remark 3. In this section we have considered how Gershgorin-type estimates 
can be used to estimate the inverse spectrum of a matrix M e VV"^". We 
note that the same is true of the eigenvalue estimates associated with Brauer, 
Brualdi, and Varga (see \^ for details). 



3. Pseudospectra and pseudoresonances 

A pscudospcctrum of a matrix M S C"^" is essentially the collection of 
scalars that behave, to within a given tolerance, as an eigenvalue of M . These 
values indicate to what extent the eigenvalues of the matrix M are stable under 
perturbation of the matrix entries. See e.g. 110] for a review of pseudospectra 
including their history and applications. 

We first extend the notion of pseudospectra to matrices in W"^". Then 
we show that the spectral inverse of a matrix can be used to define inverse 
pseudospectra for matrices in W^^". The inverse pseudospectra or pseudoreso- 
nances of M are the scalars that behave, to within a certain tolerance, as inverse 
eigenvalues or resonances of M. 



We study pseudoresonances and their relation to pseudospectra in Section 3.2 
In Section |3.3| we show that an isospectral reduction shrinks the pseudospec- 
trum of matrix for a given tolerance. Throughout this discussion we consider 
the simple mass-spring network introduced in Section |2.2| to give a physical 
interpretation to these concepts. 

Before formally extending the notion of pseudospectra to matrices in W"^" 
we note that pseudospectra has been previously generalized to matrix polyno- 
mials in [21 [T] . 

3.1. Pseudospectra 

For a matrix A e C"^", if A G o'(^) then there is always at least one 
eigenvector v e C" of A associated with A. However, recall from Section |2.1| 
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that a matrix M(A) G W"^" may have an eigenvalue Aq for which M(Ao) is 
undefined. This may seem problematic especially if we would like to find an 
eigenvector associated with Aq. In fact, it is still possible to do so. 

Assmning Aq is a solution to the equation dct(M(A) — XI) = 0, the standard 
theory of linear algebra implies that there is a vector v such that when the 
product (M(A) — A7)v is evaluated at A = Aq, the result is the zero vector. 
Keeping this sequence in mind, we define the product of a matrix and vector as 
follows. For any M(A) G W"^" and v e C" we let the product 



This definition allows us to associate an eigenvectors to each eigenvalue of a 
matrix M(A) G W"^". To demonstrate this idea we give the following example. 

Example 10. Consider the matrix M{X) e W^^^ given by 



Here, one can readily see that a{M) = {1, 1}. Although M(l) is undefined, the 
vector V = [1 0]"^ has the property 



(M(l) - l/)v = 



1-^ ih 1 




1— ' 






■ " 


1-s 















By definition the vector v is an eigenvector associated with the eigenvalue 1 
despite the fact that M(A) is not defined for A = 1. 
Importantly, for the vector norm 1 1 • 1 1 we have 




Hence, the size of {M{X) — \I)w varies continuously with respect to A even where 
M(A) is undefined. This is useful since we study values of X that act almost like 
eigenvalues of M{X). 

Suppose that for a given tolerance e > 0, there is a scalar A e C and a 
unit vector v e C" for which ||(M(A) — A7)v|| < e. If this is the case then the 
vector V is said to be an e-pseudoeigenvector of the matrix M(A) corresponding 
to the e-pseudoeigenvalue A. The e— pseudospectrum of M(A) is defined as the 
set of all such A. We state this and two other equivalent definitions of the 
e— pseudospectrum below. For C C, let c/(f2) be the closure of Q. in C. 

Definition 6. Let e > 0. The e-pseudospectrum of M{X) € WJJ^" is defined 
equivalently by: 

(a) Eigenvalue perturbation.- 



CT,(M) = d({A G C : ||(M(A)-A/)v|| < e for some v G C" with ||v|| = 1}). 



(M(A) - A/)v = (M(s) - s/)v|,=A. 



M(A) = 





||(M(A)-A/)v|| 



1 - A 
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-1 - 




1 
ae(M) 



-1 




-10 12 

a,(i?(M; {1,2})) 



Figure 3: Pseudospectra of the matrices given in example [2]for e = 1 (blue), e = lO-^/^ 
(green) and e = 10~^ (red), obtained with the matrix 2-norm. The respective spectra are 
indicated by "x". 



(b) The resolvent; 

a,{M) = d{{X e C : ||(Af(A) - A/)-i|| > e'^}). 

(c) Perturbation ol the matrix; 

tT,(M) = d({A e C : A e a{AI{X)+E) for some E e C"''" with \\E\ \ < e}). 

As a consequence ol definition |6j the eigenvalues ol a matrix M € W^^" 
belong to all its pseudospectra: 

a{M) C cre(Af) for each e > 0. 

The prool that definitions [6j^a)-(c) are equivalent (provided the vector norm in 
(a) and the operator norm in (b)-(c) are consistent) refies on the proof that 
definitions |6][a)-(c) are equivalent for scalar valued matrices. For completeness, 
the proofs are included in Appendix B 



We now compare the pseudospectra of a matrix and its reduction. 

Example 11. Consider the matrices M and R{M; B) given in example^where 
B ~ {1,2}. The pseudospectra of both matrices are displayed in figure^ for 
e = 1, 10-1/2, 10-1 using the matrix 2-norm. Notice that although 0, 1 € a{M) 
these values do not belong to a{R{M]B)) because of cancellations resulting from 
the matrix reduction, i.e. Mix = {0,0,1,1}. However, for the e we consider 
0, 1 G (Jt{R{M;B)) meaning that these eigenvalues remain as pseudoeigenvalues 
of the reduced matrix. 



To give a possible physical interpretation of pseudospectra we again consider 
a mass-spring network. 
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-10 12 3 4 5 



-10 12 3 4 5 
a,{R{K; {1,2})) 



Figure 4: Pseudospectra of the stiffness matrix K for the mass spring system in example |4] 
and of its reduction (X, {1, 4}). The latter corresponds to the effective stiffness of the 
mass-spring system when we only have access to nodes {1, 4}. The tolerances shown are e = 1 
(blue), e = 10-1/2 (green) and e = lO'^ (red), using the matrix 2-norm. The "x" correspond 
to spectra of the respective matrices. 



Example 12. For the mass-spring network considered in example^ recall that 
the eigenvalues of K correspond to frequencies for which there exists a non-zero 
displacement that generates no forces on these nodes. The pseudoeigenvalues of 
this system have a similar physical interpretation. Namely, the pseudospectra 
indicate the frequencies for which there is a displacement that generates "small" 
forces relative to the ( norm of the ) displacement. 

For example, as the frequency uj^ = 2.1 in figure^right) is within the green 
tolerance region there is a non-zero vector of displacements such that the forces 
generated from this displacement have norm e = 10^^/^ times less than the norm 
of this displacement vector. That is, if we only have access to the boundary nodes 
B = {1,4} then the pseudoeigenvalues of R^-2{K;B) correspond to frequencies 
for which there is a displacement at the boundary nodes B that generates very 
small forces on these nodes. The pseudospectra regions of R\{K;B) are shown 
in figure^b) for e = 1, lO^^/^, lO-^. 

Observe that the pseudospectra of Rx{K; B) are included in the pseudospectra 
of K for a given tolerance e. That is, less access to network nodes means there 
are less frequencies for which displacements generate relatively small forces. 
Phrased less formally, the more a network is reduced, the less susceptible to 
perturbations its eigenvalues are. 



Note that in both examples 11 and 12 we have a{M) C cr^{R{M;B)) for 
the e we consider. It seems that even under reduction, the e-pseudospectrum 
remembers where the eigenvalues of the original matrix are. However, this is 
not always the case, as the following example shows. 

Example 13. Consider the matrix M S C'^^'^ given by 



M = 



1 

1 
1 
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with a{M) = {0,±1}. By reducing M over B = {1} we obtain the matrix 
R{M;B) = [1/A] for which 

\\{R{M-B)-Xir^ ^ 



1- A2 

Hence, (f. a^{R{M] B)) for any e. Moreover, as a{Mxi) — {0,0} for X = 
{2, 3} it is not always the case that either a{AI) or a{Mxi) is contained in 
a,{R{M-B)). 

3.2. Pseudoresonances 

Recall that the resonances of a matrix M(A) G W^^" are the eigenvalues 
of its spectral inverse. Thus we may think of "almost resonances" or pseu- 
doresonances of M(A) as pseudoeigenvalues of S{M). The precise definition is 
below, together with other equivalent definitions. These are analogous to the 
pseudospectra definitions [6]^ a)~(c). 

Definition 7. Let e > 0. The set of e~ pseudoresonances of a matrix M(A) S 
^nxn defined equivalently by: 

(a) Resonance perturbation: 

a-^M) = d{{X £ C : || (M(A)-A/)- V|| < e for somew e C" with ||v|| = 1}). 

(b) The inverse resolvent: 

G^^{M) = d({A G C : ||Af(A) - AJ|| > e-^}). 

(c) Perturbation of the spectral inverse: 

(j-^{M) = c/({A e C : A e a{S{M)+E) for some E e C"""' with\\E\\ < e}). 

Note that definition [t] is simply definition |6] in which Af (A) is replaced by the 
matrix S{M) on the right hand side of parts (a)-(c). Hence, the equivalence 
of definitions [7][a)~(c) follow from arguments similar those in Appendix B 
Moreover, if Af(A) e W;^" then 

cr"^(Af) C a-\M) for each e > 0. 

Observe that if w{X) — p{X)/q(X) E W^r then by definition 7r(p) < Tr{q). 
Hence we have the limit, 

lim |'i«(A)| = c, 

I A|-^oo 

for some constant c > 0. Therefore ||A'f(A) — A/|| — 0{X) for large A, for matrices 
M G W;f^". This leads to the following remark. 

Remark 4. If M G W"^" then the value X — oo is always a pseudoresonance. 
This means that for each e > the set a~^{M) contains the complement of a ball 
centered at the origin with sufficiently large radius. (See figure^ for example.) 
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Figure 5: Pseudoresonance regions for the matrix H(M;{1,2}) given in example |2] with 
e = 10~^/^ (red), and e = 10~^ (blue). All the points in the display region belong to the 
pseudoresonance region for e = 1. 



Example 14. In figure we show the pseudoresonance regions of the matrix 
R{M; {1, 2}) from example^for e — 1, 10~^/^, 10"'^. As is shown in example^ 
the inverse spectrum o/ i?(Af; {1, 2}) is empty. However, the pseudoresonance 
regions reveal that the eigenvalues cr(Afxi) — {0, 1} act as resonances. Specifi- 
cally, a{Mii) C a^HRiM; {1,2})). 

In figure^ fl^-ft) o,f^d figure^ note that for the e we consider 

a,{R{M- {1, 2})) n <7-\R{M- {1, 2})) ^ 0. 

That is, values near the set a{Mxx) = {0, 1} are both e-pseudoeigenvalues and 
e-pseudoresonances of R{M; {1, 2}). 

As it turns out, the situation in example |14| does not hold for every matrix 
reduction. Similar to example |13| if 



M = 



1 1 




and we consider the sets B = {1} and I — {2}, then one can show the set 
(t(Mii) = {0} is not contained in a~^{R{M;B)) for smah e > 0. That is, the 
eigenvalues a{Mix) do not always act as resonances of R{M;B). 

As with the pseudospectra studied in Section |3.1| we give a physical inter- 
pretation of pseudoresonances using a mass spring system. 

Example 15. The mass spring system considered in example^has resonances 
when restricted to a set of boundary nodes B C {1,4}. The pseudoresonances of 
the reduced system correspond to frequencies for which there is a displacement 
on the boundary that generates relatively large forces at these nodes. In figure^ 
we display some pseudoresonance regions of the mass-spring system restricted 
to the set B = {1,4}. 
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As we allow e to be any positive value there is nothing preventing an eigen- 
value of a matrix M from also being an e-pseudoresonance of M (or a resonance 
from being a e-pseudoeigenvalue) . In other words, we could have an e > for 
which 

a-^[M) n (T,{M) 7^ or a{M) n (7-^{M) ^ 
as the following example shows. 

Example 16. Consider the following matrix Af(A) G W^^^ given by 



M{X) 







The spectrum and inverse spectrum of M{\) are respectively 

ct{M) = {0, (1 ± V5)/2} and a-\M) = {!}. 
Now notice that for S a{M) we have 

|lAf(0)-0/|| = 1, 
which implies that G a~^{AI) for all e > 1. The resolvent of AI is 



A-l 

-A2 + A+1 





-h 



(M(A) - A/)-i 
Hence, for X = 1 we have 

|l(M(l)-/)-i||^l, 
which means that 1 G crc(^) for all e > 1. 

As the pseudoresonances of a matrix AI e W"^" can be defined in terms of 
the pseudoeigenvalues of the spectral inverse S{M), we can generalize theoremjs] 
as follows. 

Theorem 8. Suppose M(A) e W;j^" and e > 0. Then 

cr7i(M) = cT^iS{Ad)) and a^{AI) = CT7i(S'(Af)). 

Proof Let A/(A) e W^f^" and e > 0. Observe that, 

(T,(A//) = d({A e C : \\{M{X) - XI)-^\\ > e-^}); and 



-^(^(A//)) = d({A e C : ||S'(A/) - A/|| > e-^}) 



from definitions [elb) andgb) respectively. Since S{AI) - XI = (A//(A) - XI)~^ 
then c7e(M) = a^{S{AI)). The equality a-^{AI) = a,{S{AI)) follows similarly. 

□ 
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Figure 6: Pseudoresonance regions of the matrix Rx{K\ {1,4}) given in example|4] for e = 1 
(blue), e = 10~^/^ (green) and e = 10~^ (red). Resonances are shown with X. All the points 
in the display region, the white region excepted, belong to the pseudoresonance region for 
e = 1. 

Because of the seemingly invertible relationship between pseudospectra and 
inverse pseudospectra in theorem|8] it is tempting to think the e— pseudoresonances 
of a matrix is the complement of its e~^— pseudoeigenvalues. In general, how- 
ever, the two are not equal as can be seen in the next proposition. 

Theorem 9. For M{\) e W;'^" let e > 0. Then cl{ai/^{M)) C a^'^iM). 
However, the reverse inclusion does not hold in general. 

This theorem means that, in general, there is not enough information in the 
pseudospectra of a matrix to reconstruct its pseudoresonances. We now proceed 
with the proof of the proposition. 

Proof. For M{\) £ W^^" and a matrix norm || • ||, the inequality 

||M(A)-A/|ri<||(Af(A)-A/)-i|| (22) 

holds for any A G dom (M) — a{M). Let int(ri) denote the interior of the set 
J7 C C, i.e. the largest open subset of fi. For e > 0, using definition |6|^b) 

d{<Ji/,{M)) = d(d({A e C : ||(M(A) - A/)-i|| > e})) 
= d(int({A e C : ||(M(A) - A/)-i|| < e})) 
= d({A e C : ||(M(A) - Xiy^\\ < e}) 

Similarly, it follows from definition [Tj^b) that 

aZ\M) = cl{{X e C : ||A/(A) - A/|| > e'^}) 
^cl{{XeC: \\M{\)-XI\\-^ <e}). 

By inequality ( p2| the set 

{A e C : ||(M(A) - A/)|ri < e} C {A € C : ||(M(A) - XI)-^\\ < e} 
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implying the first half of the result. 

To show that the reverse inclusion does not hold in general, take for instance 
the matrix M(A) from example 16 It is easy to compute ||-M(2) — 2/|| = 2 
and ||(M(2) - 2I)-^\\ = 1. Taking e = 2/3, we clearly have 2 e (t~I^{M) n 

(73/2 (M). □ 

3.3. Pseudo spectra Under Isospectral Reduction 

One of the major goals of this paper is to understand how the pseudospectra 
of a matrix M £ W^^" is affected by an isospectral reduction. In order to study 
this change in pseudospectra, we need to consider two vector norms. Specifically, 
we need one norm |j • |j defined on C" for the pseudospectrum of M and another 
norm || • ||' defined on C™ (m < n) for the pseudospectrum of R{M]B). Our 
comparison of the pseudospectra of the original and reduced matrices assumes 
that for V = (vg . Vj £ C" these two norms are related by 



> 







(23) 



Examples of norms satisfying property (23 1 are the norms for 1 < p < oo. 
For the sake of simplicity, we use the same notation for both of these C" and 
C™ norms. 

The following theorem describes how the e-pseudospectrum of a matrix 
M(A) is related to the e-pseudospectrum of the isospectral reduction R\{M]B). 
It says that the e-pseudospectra of the reduced matrix is contained in the e- 
pseudospectra of the original matrix for each e > 0. 

Theorem 10. For M{\) e W;'^" let B d N. Then a^{R{M;B)) C ct,(M) 
for any e > provided the C" and C''^' norms in the pseudospectra definitions 



satisfy ( 23 ) 



Proof. For M(A) e W"^" let B and I form a non-empty partition of N. We 
assume, without loss of generality, that for a vector v e C" we have v = 

For Aq G C and e > suppose there is a unit vector vg e C'^' such that 



||(i?(M;S)-Ao/)vB|| <e. 



(24) 



As cr{Mxx) and dom (M) arc finite sets, then by continuity there is a neighbor- 
hood U of Aq such that 

(i) M(A) e C"^" for A e L/ - {Ao}; 

(ii) aiMix) niU- {Ao}) = 0; and 

(iii) ||(i?(M;6)-A/)ve|| < e for A e [/ - {Ao}. 

Observe that, for each Ao G ?7 — {Ao} it follows that the vector 
VI = -(Af(Ao)ii - Ao/)"^Af(Ao)iBVB 
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is defined. Let v = (vg,vj)^ and note that 
(M(Ao) - Ao/)v = 



A=An 



(M - \I)bb^b + [M - A/)bivx 
(M - A/)ieve + [M - 

Mbb^b - Mbx{Mxx - Xiy^MiB^TB 
MxbVb - {Mix - \I){Mxx - >^iy^MxB^B 

{R{M-B) - \I)wB ' 







A=Ao 



By the property ([23]) of tlie norms in C" and C'^' wc must have 
||(M(Ao) - Ao/)v|| = ||(i?(Af(Ao);6) - Ao/)ve|| < e. 



A=Ao 



(25) 



Again by ( 23 ) we have 



As vg ^ 0, consider the unit vector u — v/||v|| e 1 
||v|| > ||ve|| = 1. Hence, we get the bound 

||(A/(A„) - Ao/)u|| ^ ll(^-^(Ao) ^ ^o/)v|| ^ 11^^^^^^^ _ ^^^^^ij ^ 



where the last inequality comes from ( [25| . This implies Aq G a^{M). 

As this holds for any Aq G C/ - {Aq} then Aq G cI{(j^{M)). Since af_{M) 
is a closed set then in fact Aq G cre(Af). Since Aq is an arbitrary point in 
ae{R{M; B)), the result follows by inequality ([24]). □ 



Remark 5. Theorem \10\ states that the e-pseudospectrum of a matrix becomes a 
subset of this region as the matrix is reduced. However, for e-pseudoresonances 
of a matrix there is no such inclusion result. 

Example 17. In the mass-spring system of example\^ we consider four dif- 
ferent sets of boundary nodes {1,2,3,4} D {1,2,4} D {1,4} D {1}. Note that 
theorem \10\ implies that the corresponding pseudospectra for a given e obey the 
same inclusions. This is shown in figureyAfor e ~ 1. 10^^/^, and e — 10~^. 

In physical terms, this means that as we increase the number of internal 
degrees of freedom (or decrease the number of boundary nodes), it becomes harder 
to find frequencies for which there is a displacement that generates forces of 
magnitude below a certain fixed level. Hence the less boundary nodes we have, 
the more robust are the frequencies that generate small forces. 



Notice that the inclusion given in theorem 10 is not a strict inclusion. In 
fact, it may be the case that a matrix M and its reduction R{M;B) have the 
same pseudospectra as the following example demonstrates. 

Example 18. Consider the matrix M G C4x4 ^j^g^ 



M 



110 
110 
11 
11 



and its reduction R[M; B) 







A 

A-1 

1 1 
1 1 
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-1 



# ® 
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Figure 7: Pseudospectra of the matrix K from the mass-spring system of example W] (blue) 
together the pseudospectra for the reduced matrices where the terminal nodes are B = {1, 2, 4} 
(cyan), B = {1,4} (green) and B = {1} (red). Note how the pseudospectra shrink as the 
number of boundary nodes decreases. 
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where B — {2,3,4}. Computing the Euclidean induced matrix norm of the 
resolvents we get 



|1(M - Xiy^W = max(|Ar\ |A - 2\-^) and 
||(i?(M;6) - Xiy^W = max(|A|-\ |A - 2\'\ |A - l||A|-i|A - 2\~^). 

To show that the pseudospectra of M and R{M; B) are the same, we only 
need to demonstrate that the norms above are equal. This happens if we can 
show the inequality 

|A - lllAr^lA - 21-1 < max(|A|-\ |A - 21-1). (26) 

Notice that the triangle inequality implies 

|A - 1| < i|A - 2| + i|A| < max(|A|, |A - 2|). (27) 



Inequality ([26]) follows for \ {0,2} by dividing ([27]) by |A||A-2|. As {0,2} C 
tT(A/), (j{R{M] B)), then both and 2 are included in the pseudospectra of these 
matrices. We conclude that a^^M) = a^{R{M;B)) for all e > 0. 



4. Conclusion 

Isospectral graph reductions allow one to reduce the size of a matrix while 
maintaining its set of eigenvalues up to a known set. Prior to this paper it 
was known that a matrix could be isospectrally reduced over any principal 
submatrix of a particular form. One of our main results removes this restriction. 
This new, more general method of isospectral reduction allows one to reduce a 
matrix over any principal submatrix without any other consideration (other than 
existence). Consequently, we are able to study matrix reduction in a simpler 
and computationally more efficient way compared with those used in [H |6l [5] . 

An additional improvement to previous work is the introduction of a spectral 
inverse. The spectral inverse of a matrix, which interchanges a matrix' spectrum 
and inverse spectrum, allows one to use the previous results found in [H [51 [S] 
to analyze the inverse spectrum of a matrix. In particular, we show that the 
Gershgorin-type estimates in j4j can also be used to estimate a matrix' inverse 
spectrum. 

One of our main goals here is determining whether the notion of pseudospec- 
tra can be extended to the class of matrices we consider. In fact, because a 
matrix with rational function entries has both a spectrum and inverse spectrum 
we are able to extend the notion of pseudospectrum to such matrices and also 
introduce the notion of inverse pseudospectrum. Moreover, we are able to show 
that the pseudospectrum of a matrix shrinks under reduction. Therefore, the 
eigenvalues of a reduced matrix are less susceptible to perturbations. This fact 
has implications to systems modeled by reduced matrices. 

For instance, the mass spring network we consider throughout this paper is 
modeled using a matrix with integer entries. However, if we have access to only 
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some terminal nodes, the frequency response at the terminals is a matrix with 
rational function entries which can be obtained by reducing the stiffness matrix 
where all nodes are terminal nodes. Our result shows that having less terminal 
nodes, means the eigenvalues of the frequency response are less susceptible to 
perturbations than the eigenvalues of the matrix where all the nodes are terminal 
nodes. 
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Appendix A. Properties of the Degree of a Rational Function 

Suppose Wi — Pi{X) / qi{X) where Pi{X), qi{X) G C[A] and (ji(A) is nonzero for 
1 < i < n. Then for 1 < i, j < n it is easy to show the following properties hold: 

n 

7r(^Wi) = max {iriwi) : Wi ^ O}; (A.l) 

i=l 

^TT ^ |y]'^(^') ifVie {I,--- ,n} 7^0 
[O otherwise; 

TT(wi/wj) ^ { ^ " ^ ^' * ^ for w, ^ 0; and (A.3) 

10 otherwise 

^T{w^ - A) = 1 for Wi G W^. (A.4) 



Appendix B. Eigenvalue Inclusions &; Equivalence of Definitions [6]^ 

Here we first show that the three pseudoeigenvalue regions in definition|6]^a)- 
(c) are equivalent and include the eigenvalues of the matrix. The proof relies 

on the fact that the sets 

(a) cre(M) = {A e C : ||(Af - A/)v|| < e for some v G C" with ||v|| = 1}; 

(b) (T,(M) = {A e C : ||(M- A/)-i|| > e-^}Ua{M); and 

(c) cr,(M) = {A e C : A e cr(Af + E) for some E £ C"^" with < e}. 

are equivalent for any M e C"^" and e > 0. This result can be obtained by 
following the proof at http : / /www . cs . ox . ac. uk/pseudospectra/thms/thml 7] 
IdfJ 

Theorem 11. Let M(A) G W^f^" and e > 0. Then definitions^ a) -(c) are 
equivalent. Moreover, a{M) C ac{M). 

Proof. For Af (A) e W^f^" and e > let 
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(a) (T,,a(M) = {A e C 

(b) ae,6(M) = {A e C 

(c) a,,e(M) = {A e C 



||(M(A) - A/)v|| < e for some v G C" witli ||v|| = 1}; 
||(M(A) - A/)-i|| > £-1} U cr(M); and 
A e (t(M + E) for some E e C"^" witlr < e}. 

Suppose Aq e (T(Af). Then tliere is a unit vector v G C" sucfi that 

(Af (A) - A/)v = w{X) e W;j 



where w(Ao) = 0. Since a{M) and dom (M) are finite then there is a neighbor- 
hood U B Xo such that for J7 = U — {Ag}: 

(i) C/ C dom(Af); 
(h) ||w(A)|| < e for A e [/; and 
(iii) (a(Af) - {Ao}) n C7 = 0. 

In particular, (ii) implies the set U C a^^aiM). 

For A £ dom(M) observe that the matrix A/(A) e C"^". Since (a)-(c) are 
equivalent for any complex valued matrix then 

U C <J,,a{M) - {Ao}, fT.,fc(Af) - {Ao}, a,,,(M) - {Aq}. 

This in turn implies 

a{M) C cl (ae,a (M)) , c/ ( AT) - a( Af)) , cl (a,,, (M)) . (B . 1) 

In particular, if cre,b(A/) — cr(Af) is open then ae,b{M) is open. 

Note that the norm of a vector or matrix is continuous with respect to its 
entries. Also, the eigenvalues of a matrix depend continuously on the matrix en- 
tries. Thus, the sets ae,a{M), a^^b{M) — a{M), and a^^dM) are open. Therefore, 
the set (7e_{,(Af) is also open. 

Since the sets (a)-(c) are equivalent on dom (Af ) and dom (M) is finite then 

(T^^a{M) n dom (Af) = cre,fc(Af) n dom (Af) = a^AM) n dom (A/) 
is an open set. Taking the closure it follows that 

d(a,,a(A/)) = cl{a,AM) - (t{M)) = d{a,AM)) 



implying that definitions |6ja)~(c) are equivalent. Moreover, equation B.l 



im- 



plies a{M) C (J^M). □ 

The proof that definitions [7]ja)-(c) are equivalent is very similar to the proof 
of theorem [Til and is therefore omitted. 
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